About

Kanwarjeet Singh Dhaliwal is a highly skilled data science professional with over 8 years of experience in the field. He is currently working as a Big Data Engineer at Teranet Inc., where he is involved in developing data pipelines using distributed frameworks such as Spark and Map Reduce, streaming framework Kafka, and query tools like Hive, SQL, and Impala. His work drives critical business decisions and provides streamlined data to various LOBs. Kanwarjeet has reduced the data processing time by 70% using distributed computing. He is also involved in feature engineering for Automated Valuation Model, which is used by financial services institutions to reduce mortgage risks. Prior to Teranet Inc., Kanwarjeet worked as a Senior Analyst in Algorithms and Data Science at Estee, where he developed mathematical predictive models using exchange's live market data to predict market movement. He also developed and implemented algorithms for effective automated quoting in the stock exchange on the basis of the model predictions in the live market. Kanwarjeet has experience in integrating new frameworks and technologies like Remote Debugging, OneTick, and Eclipse with the existing model development and implementation process. Kanwarjeet also worked as an Analyst in Decision Science at American Express, where he developed, evaluated, implemented, tracked, and maintained predictive models for evaluating new applicant's risk and provided critical analytical support for business partners in Marketing and Strategy. He partnered with the Big Data team to leverage Hadoop and machine learning algorithms into the existing model development framework to calculate highly optimized and accurate model predictions. Kanwarjeet has also leveraged machine learning techniques like Gradient Boosting Trees to predict income for new USA credit card applicants. Kanwarjeet has a degree in Integrated M.Tech (Bachelors and Masters) in Mathematics and Computing from the Indian Institute of Technology, Delhi. He has expertise in Big Data, Data Engineering, ML, SQL, Data Scientist, Spark, Kafka, Python, Research Scientist, Apache Hive, Scala, and Hadoop. Kanwarjeet is a skilled professional who can drive critical business decisions using his expertise in data science and machine learning.